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AUTHENTICATABLE GRAPHICAL BAR CODES 

CROSS-REFERENCE TO RELATED APPLICATIONS 

Under 35 U.S.C. § 120 this application claims the benefit of co-pending U.S. 
Patent Application No. 09/579,070, filed May 25, 2000, by Doron Shaked et al., and 
5 entitled "A Method and Apparatus for Generating and Decoding a Visually Significant 
Bar Code," which is incorporated herein by reference. 



that represent data elements or characters. The bars represent strings of binary ones 
and the spaces represent strings of binary zeros. A conventional "one-dimensional n 
bar code symbol contains a series of bars and spaces that vary only in a single 
dimension. One-dimensional bar code symbols have relatively small information 

15 storage capacities. "Two-dimensional" bar codes have been developed to meet the 
increasing need for machine-readable symbols that contain more information than 
one-dimensional bar code symbols. The information storage capacity of two- 
dimensional bar code symbols is increased relative to one-dimensional bar codes by 
varying the bar code patterns in two dimensions. Common two-dimensional bar 

20 code standards include PDF417, Code 1, and Maxicode. One-dimensional and two- 
dimensional bar code symbols typically are read by optical scanning techniques (e.g., 
by mechanically scanned laser beams or by self-scanning charge-coupled devices 
(CCD's)) that convert a printed bar code symbol into electrical signals. The electrical 
signals are digitized and decoded to recover the data encoded in the printed bar code 

25 symbol. 

Bar codes may be used in a variety of applications, including low information 
content applications (e.g., automatic price tagging and inventory management), and 
relatively high information content applications (e.g., encoding mail addresses and 
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This invention relates to authenticatable graphical bar codes. 
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A bar code symbol is a pattern of parallel bars and spaces of various widths 
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postage for automated mail reading and mail distribution systems, and encoding 
compressed content of a printed page). 

In many applications, it is desirable to authenticate the source of information 
or the information itself, or both. For example, in order to create certain written 

5 instruments (e.g., a bank draft or check authorizing the withdrawal of money from a 
bank account, or a postage indicia printed on an envelope) it is necessary to 
authenticate the source of the information creating the instrument (e.g., the identity 
of person authorizing the bank withdrawal or printing the postage indicia) . In 
addition, in certain applications there is a need to verify whether a communication 

10 received by a recipient is the actual communication that was sent by the sender (i.e., 
that a communication has not been intercepted, modified, or replaced). 

SUMMARY 

The invention features an inventive scheme (systems and methods) for 
generating and decoding authenticatable graphical bar codes. 
15 In one aspect, the invention features a bar coding method in accordance with 

which a corroborative signed message is generated from information to be encoded, 
and a base image is modulated with a graphical encoding of the signed message to 
produce a marked image. 

As used herein, the term "corroborative signed message" refers broadly to a 
20 message by which the sender of information or the information itself, or both, may 
be authenticated. 

Embodiments of the invention may include one or more of the following 
features. 

The step of generating the signed message preferably includes producing a 
25 cryptographic hash from the information to be encoded. The cryptographic hash 
may be produced by passing the information to be encoded through a one-way 
function, such as SHA or MD5. The step of generating the signed message preferably 
also includes encrypting the cryptographic hash to produce a digital signature. The 
cryptographic hash may be encrypted with a private key. The step of generating the 
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signed message may include concatenating the information to be encoded and the 
digital signature. The signed message may include a public key certificate. 

In one embodiment, the base image includes an image of a handwritten 
signature. The base image modulating step may include vectorizing the handwritten 
5 signature image. A set of base control points may be obtained for the vectorized 
handwritten signature image, and the information may be encoded by displacing the 
base control points to obtain a marked set of control points from which the marked 
image is produced. 

In some embodiments, the base image modulating step includes modulating a 

10 halftoning process based upon the information to be encoded. 

The signed message may be extracted from the marked image. The signed 
message preferably is extracted from the marked image based upon a comparison of 
the marked image and the base image. The extracted signed message may be 
decoded to produce a decoded message. An original encrypted cryptographic hash 

15 and the encoded information may be extracted from the decoded message. The 
encrypted cryptographic hash may be decrypted with a public key. The extracted 
information may be authenticated by producing a new cryptographic hash from the 
extracted information, and comparing the new cryptographic hash with the original 
cryptographic hash. 

20 In another aspect of the invention, a signed message is extracted from a 

scanned image based upon a comparison of the marked image and a base image. 

The extracted signed message is decoded to produce a decoded message. 

Information encoded in the marked image is extracted from the decoded message. 
An encrypted original cryptographic hash may be extracted from the decoded 
25 message. The encrypted original cryptographic hash may be decrypted with a public 

key. The extracted information may be authenticated by producing a new 

cryptographic hash from the extracted information, and comparing the new 

cryptographic hash with the original cryptographic hash. 

In another aspect, the invention features a computer program residing on a 
30 computer-readable medium. The computer program comprises computer-readable 

instructions for causing a computer to generate a corroborative signed message from 
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information to be encoded, and to modulate a base image with a graphical encoding 
of the signed message to produce a marked image. 

Other features and advantages of the invention will become apparent from the 
following description, including the drawings and the claims. 

5 DESCRIPTION OF DRAWINGS 

FIG. 1A is a diagrammatic view of a system for encoding information into a 
marked image. 

FIG. IB is a flow diagram of a method of encoding information into a marked 

image. 

10 FIG. 2 is a flow diagram of a method of generating a corroborative signed 

message from information to be encoded. 

FIG. 3A is a diagrammatic view of a system for extracting information from a 
marked image. 

FIG. 3B is a flow diagram of a method of extracting information from a 
15 marked image. 

FIG. 4 is a flow diagram of a method of authenticating information extracted 
from a marked image. 

FIG. 5A is a flow diagram of a method of rendering a base image with a 
graphical encoding of a signed message. 
20 FIG. 5B is a table mapping information to a two-bit bi-level graphical code. 

FIG. 6A is a base image containing an image of a handwritten signature. 

FIG. 6B is a marked image containing a signed message encoded in a likeness 
of the handwritten signature of FIG. 6A in accordance with the encoding process of 
FIG. SB. 

25 FIG. 7 A is an image of a spline-fitted version of the handwritten signature of 

FIG. 6A. 

FIG. 7B is a table mapping information to a two-bit control point offset code. 
FIG. 7C is a marked image containing a signed message encoded in a likeness 
of the handwritten signature of FIG. 6A in accordance with the encoding process of 
30 FIG. 7B. 
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DETAILED DESCRIPTION 

In the following description, like reference numbers are used to identify like 
elements. Furthermore, the drawings are intended to illustrate major features of 
exemplary embodiments in a diagrammatic manner. The drawings are not intended 
5 to depict every feature of actual embodiments nor relative dimensions of the depicted 
elements, and are not drawn to scale. 

Referring to FIGS. 1A and IB, in one embodiment, a system 10 for encoding 
information 12 into a marked image 14 includes an encoder 16 and a printer 18. 
Encoder 16 may be a computer or other programmable processor, and printer 18 may 

10 be a conventional printer (e.g., a LaserJet® printer available from Hewlett-Packard 
Company of Palo Alto, California, U.S.A.) or a special-purpose label printing device. 
In operation, encoder 16 generates a corroborative signed message from information 
12 (step 20). Encoder 16 modulates a base image 22 with a graphical encoding of 
the signed message to produce marked image 14 (step 24). Base image 22 may be 

15 any graphical pattern, including a logo (e.g., a company logo), graphics, pictures, 
text, images, or any pattern that has visual significance. The signed message may be 
embedded in the graphical design of text, pictures, images, borders, or the 
background of base image 22 to produce marked image 14. The information may be 
embedded in marked image 14 in the form of a binary image (e.g., a black and white 

20 dot pattern), a multilevel image (e.g., a gray-level image), or a multilevel color 
image. Printer 18 renders a hard copy 26 of marked image 14 that may be 
transferred physically from a sender to a recipient (step 28). Hard copy 26 may be in 
the form of any one of a wide variety of printed materials, including a bank draft (or 
check) carrying a marked image of a withdrawal authorization signature, a stock 

25 certificate or bond carrying a marked image of an authenticity certification, and an 
envelope carrying a marked image of postage indicia. In other embodiments, marked 
image 14 may be rendered by other printing processes. Alternatively, marked image 
14 may be rendered in an electronic format. 

Referring to FIG. 2, in one embodiment, encoder 16 may be programmed to 

30 generate a corroborative signed message from information 12 as follows. Encoder 16 
produces a cryptographic hash from information 12 (step 30). The cryptographic 
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hash may be generated by passing information 12 through a one-way encryption 
process (or digesting process), such as a hashing routine. Preferably, the digesting 
process is configured such that the probability that two different electronic 
documents will generate the same cryptographic hash is very low. Encoder 16 
5 encrypts the cryptographic hash to produce a digital signature (step 32). In an 
asymmetric (public key) cryptographic embodiment, the cryptographic hash is 
encrypted with the sender's private key. Encoder 16 concatenates information 12 
and the digital signature to generate a signed message (step 34). In some 
embodiments, a public key certificate is appended to the signed message (step 36). 
10 The public key certificate may be issued by a certification authority. The public key 
certificate may contain a certification by a certification authority that a particular 
public key is the public key of a particular entity (e.g., the sender), and that this 
2 entity is the holder of the corresponding private key. In addition, the public key 

==: certificate may contain, among other items, the name of the certification authority, 

W 15 the name of the certificate holder, the expiration date of the certificate, the public key 
[jS of the certificate holder, and a digital signature generated by the certification 

m authority. As used herein, the term "signed message" refers to a signed message 

M= with or without an appended public key certificate. Encoder 16 encodes the resulting 

□ signed message with an error correction code (step 38) . The error correction code 

jz 20 may be a conventional convolutional (tree) code or a conventional block code. For 
O example, the error correction code may be a standard 16 31 bit BCH code that 

corrects for three errors. 

As shown in FIGS. 3A and 3B, in one embodiment, a system 40 for decoding 
information 12 from marked image 14 includes a scanner 42 and a decoder 44. 
25 Scanner 42 may be a conventional desktop optical scanner (e.g., a ScanJet® scanner 
available from Hewlett-Packard Company of Palo Alto, California, U.S.A.) or a 
portable scanner (e.g., a CapShare® portable scanner available from Hewlett-Packard 
Company of Palo Alto, California, U.S.A.). Decoder 44 may be a computer or other 
programmable processor. In operation, scanner 42 reads hard copy 26 to produce a 
30 digitized scanned image 46 that includes marked image 14 (step 48). Decoder 44 
extracts a signed message from scanned image 46 based upon a comparison of 
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scanned image 46 and base image 22 (step 50). Decoder 44 decodes the signed 
message to produce a decoded message (step 52). The signed message may be 
decoded using a conventional error correction code decoding process. 

Referring to FIG. 4, in one embodiment, information extracted from a marked 
5 image may be authenticated as follows. Decoder 44 decrypts the encrypted 
cryptographic hash contained in the decoded message to obtain an original 
cryptographic hash (step 60). The encrypted cryptographic hash may be decrypted, 
for example, using the sender's public key, which may be obtained from an 
appended public key certificate or may be obtained in some other way. Decoder 44 
10 also generates a new cryptographic hash from the information contained in the 
decoded message using the same digesting process that was used to produce the 
^ original cryptographic hash (step 62). Decoder 44 compares the original 

y3 cryptographic hash with the new cryptographic hash (step 64). If the new 

ni cryptographic hash matches the original cryptographic hash, the information is 

CO 15 authentic (step 66). That is, the information was digitally signed by the private key 
yg corresponding to the public key that was used to recover the original cryptographic 

ry hash, and the information was not changed from the time that it was signed to the 

M time that the digital signature was verified. Thus, the authentication process of FIG. 

q 4 may be used to verify the authenticity of information 12 or the identity of the 

Jl 20 sender of information 12, or both. If the new cryptographic hash does not match the 
O original cryptographic hash (step 64), the information has been compromised (step 

68). 

If a public key certificate is appended to the extracted signed message, the 
public key certificate may provide a level of assurance as to the identity of the holder 
25 of the private key corresponding to a particular public key. The authenticity of the 
public key certificate may be tested by verifying the certification authority's digital 
signature using the certification authority's public key. 

Referring to FIGS. 5A and 5B, base image 22 may be rendered with a graphical 
encoding of a signed message in accordance with the graphical encoding scheme 
30 described in co-pending U.S. Patent Application No. 09/579,070, filed May 25, 2000, 
by Doron Shaked et al., and entitled "A Method and Apparatus for Generating and 
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Decoding a Visually Significant Bar code." In accordance with this graphical 
encoding process, base image 22 is partitioned into a plurality of sub-matrices (step 
70). A region of base image 22 is reserved for fiducial markings (step 72). Un- 
reserved sub-matrices are converted into binary bar code matrices based upon a 
5 selected encoding process (step 74). For example, in one graphical encoding 
embodiment, information may be encoded into a bi-level image by a two-bit 
encoding process based upon the two-by-two halftone patterns (or matrices) 
illustrated in FIG. SB. In accordance with this graphical encoding process, sub- 
matrices in base image 22 undergo a thresholding process and a bi-level half-toning 

10 process. For example, in one embodiment, sub-matrices in base image 22 that have 
a gray level that is less than 50% are encoded with one of the four bar code matrices 
in the 25% row of FIG. 5B. Sub-matrices in base image 22 that have a gray level that 
is at least 50% are encoded with one of the four bar code matrices in the 75% row of 
FIG. 5B. In other embodiments, the encoding threshold level may be greater than or 

15 less than 50% . The particular bar code matrix used to render a sub-matrix of base 
image 22 is selected base upon the information to be encoded. For example, if "11" 
is to be encoded at a 75 % gray level sub-matrix location, bar code matrix 76 is used 
to render that sub-matrix. Similarly, if "01" is to be encoded at a 25% gray level 
sub-matrix location, bar code matrix 78 is used to render that sub-matrix. 

20 In general, the graphical encoding process of FIGS. 5A and SB may be 

extended to n-bit encoding mappings, where n has an integer value of 1 or greater. 
For example, in one embodiment, information is encoded by a five-bit encoding 
process based upon three-by-three halftone patterns. 

As shown in FIGS. 6A and 6B, the graphical encoding process of FIGS. 5A and 

25 SB may be used to render a base image 80 that contains an image 82 of a 

handwritten signature (FIG. 6A). The resulting marked image 84 contains a signed 
message encoded in a likeness 86 of handwritten signature 82 (FIG. 6B). The signed 
message may be encoded in the handwritten signature likeness 86, the background 
image, or both. 

30 Referring to FIGS. 7A-7C, in another graphical encoding embodiment, 

handwritten signature image 82 may be rendered with a graphical encoding of a 
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signed message using a vector-based encoding process that is invariant through 
linear transformations. In particular, handwritten signature image 82 may be 
converted from a raster form image to a vector form image 88. This conversion 
process may be implemented using a standard vector graphics software program 
5 (e.g., the Adobe® Illustrator® graphics creation software available from Adobe 
Systems Incorporated of San Jose, California, U.S.A.) or another graphics software 
program having functionality that is similar to the Postscript "curveto" operator. As 
shown in FIG. 7A, the spline-fitted handwritten signature image 88 consists of a 
sequence of spline curves governed by a plurality of control points 90. The signed 
10 message is encoded in a marked image 92 by a controlled displacement of control 
points 80. For example, in a two-bit encoding embodiment, control points 90 are 
linked into a poly-line (i.e., a chain-coded sequence) with a deterministic sequence 
3 (e-S-> clockwise or counter-clockwise). One or more control points 90 are grouped 

2i together, and each group is displaced in accordance with the information to be 

OB is encoded based upon the mapping of FIG. 7B. For example, if "11" is to be encoded 
!J in a particular group of control points, the control point group is displaced one unit 

ry in a downward direction. Similarly, if "01" is to be encoded in a particular group of 

control points, the control point group is displaced one unit in an upward direction. 
q Because the encoding is achieved by only minor displacements of control points 90, 

20 the resulting marked image 92 appears to be very similar to handwritten signature 
O image 82. 

In other embodiments, different vector-based encoding schemes may be used. 
For example, in a one-bit encoding embodiment, groups of control points are 
displaced in a binary manner (e.g., stationary or displaced, displaced in a leftward 
25 direction or displaced in a rightward direction, displaced in an upward direction or 
displaced in a downward direction). A three-bit encoding embodiment may 
incorporate diagonal displacements into the encoding scheme of FIG. 7B. 

In sum, the above-described embodiments provide a novel approach for 
authenticating information that is embedded in a graphical bar code. These 
30 embodiments enable bar codes having visual significance to be generated in a 

manner that allows the source of information or the information itself, or both, to be 
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♦ 4 

authenticated. In this way, these embodiments readily may be applied to various 
applications, including authorization markings printed on a bank draft or check, and 
postage indicia printed on an envelope. 

The systems and methods described herein are not limited to any particular 
5 hardware or software configuration, but rather they may be implemented in any 
computing or processing environment. The encoding and decoding processes 
described above may be implemented in a high level procedural or object oriented 
programming language, or in assembly or machine language; in any case, the 
programming language may be a compiled or interpreted language. 
10 Other embodiments are within the scope of the claims. 

For example, although the above embodiments are described with respect to 
an asymmetric (public key) cryptographic embodiment, other embodiments may be 
implemented using a symmetric (secret key) cryptographic scheme in which the 
cryptographic hash is encrypted with the sender's secret key. In addition, although 
15 the above embodiments are described with respect to fixed-pattern halftoning 
methods, other embodiments may utilize different halftoning methods, including 
cluster dithering (e.g., blue noise) methods and error diffusion methods. 
Still other embodiments are within the scope of the claims. 
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